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SEATTLE — Margaret Spellings may be secretary emerita, but the assessment and accountability 
movements— which of course predated her commission — are alive and well. And if colleges 
think they can ignore these pushes, they are seriously misguided. That was the message behind 
speeches and the announcement of two new national education campaigns here Thursday at the 
annual meeting of the Association of American Colleges and Universities. 

One effort — further along than the other — is to create the National Institute for Learning 
Outcomes Assessment. The institute is attempting to gather information from every college 
about assessment practices in place in order to produce a national picture of the state of the 
efforts to measure student learning. Then the institute plans to conduct research on what colleges 
tell the public about assessment, to study which practices are most successful, and to produce 
case studies of how assessment works (or doesn't) in certain situations. The second effort — still 
formative — is to create the Alliance for New Leadership for Student Learning and 
Accountability, which would act as something of a public voice for higher education in national 
discussions about assessment and accountability. 

Both efforts involve to some extent some of the leading national organizations that represent 
colleges and are receiving backing from such prominent funders as the Lumina Loundation for 
Education and the Teagle Loundation. 

Explaining the efforts, backers said that colleges must get out ahead of these issues - or others 
will set up systems that could damage higher education. Higher education "cannot be playing 
defense," said Molly Corbett Broad, president of the American Council on Education. "That is 
the message of the day." 

The new institute will be led by Stanley O. Ikenberry and George Kuh — two figures with 
extensive experience in the politics of higher education and assessment. Ikenberry is former 
president of the American Council on Education and of the University of Illinois. Kuh is director 
of the Center for Postsecondary Research at Indiana University at Bloomington, and is best 
known as the founder of the National Survey of Student Engagement. 

Ikenberry raised the question that is no doubt on the minds of those who have hoped that 
assessment debates might fade with the end of the Spellings era. "Why now?" 

The answer, he said, is that assessment has been the subject of debate for 25 -plus years "but for a 
long time has seemed stuck on Page 1." With the visibility brought to the issue by Spellings, with 
moves by leading college groups to create new accountability systems, and with a proliferation 
of testing systems, "the next three to five years present a period of significant opportunity" and 
the future of assessment is "likely to be shaped in important ways," he said. Higher education 
needs to take the lead, he argued. 
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Ikenberry also reminded audience members of something they were all talking about anyway: 
College budgets are being cut everywhere. Reliable, respected systems of assessment and 
accountability, he said, will help leaders "make wise choices." 

Broad said that the current debates about assessment reminded her, somewhat painfully, of 
discussions 25 years ago about overhead costs paid by federal agencies on research grants. That 
seemingly arcane topic became controversial when members of Congress questioned some of the 
expenses universities were reimbursed for, and proposals and counter-proposals flew. 

Some in higher education resisted the discussions, saying that what universities did was "so 
intrinsically valuable that these bean counters in the federal government" didn't understand the 
issues and weren't worth taking seriously. The result. Broad said, was 25 years of "tremendously 
onerous" regulations that might have been averted had higher education engaged more 
successfully in the process. 

And she noted that President Obama has said, with regard to numerous issues, that "transparency 
is the best form of accountability," so the new administration will care about these issues. 

Judith S. Eaton, president of the Council for Higher Education Accreditation, also endorsed the 
work of the new institute. She said she hoped that better knowledge about assessment would 
improve the relationship between accreditors and institutions, and that a sustained commitment 
by higher education to accountability would preserve the principles of self-regulation for higher 
education. 

Both accreditors and colleges "need to take a commitment to credibility with the public further 
than we’ve taken it,” Eaton said. While "some folks from institutions don’t like to hear that 
[because] they think it’s an implied criticism," Eaton said they need to acknowledge that "the 
world has changed." 

She also said that she hoped the new effort would "strengthen the academic leadership of our 
colleges and universities." Eaton said that there was considerable strength among those leaders, 
but that Spellings Commission members and others had encouraged "an undermining" of that 
leadership by suggesting that colleges are against accountability. 

Even if the federal government doesn't increase regulation of accreditation, Eaton said that 
colleges needed to take it more seriously. "The institutions need to do more to treat accreditation 
as an ongoing element of quality improvement," not “an abrupt and not always welcome 
intervention," she said. 

Eaton and Broad also endorsed the still embryonic Alliance for New Eeadership for Student 
Beaming and Accountability. David Paris, a senior fellow at AAC&U, has been organizing that 
group and briefed meeting participants on the concept, which was first discussed several months 
ago at a Teagle-sponsored event in North Carolina. The new group will consist of colleges, 
associations, accreditors, presidents and faculty members; the idea grew out of discussions at the 
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high point of concerns that the Spellings Commission might do permanent damage to higher 
education with a "testing regime" or the abolition of accreditation. 

While the institute will conduct research and disseminate findings, the alliance will deal with the 
questions of "What do we say and who speaks for us?" when higher education is asked about 
accountability, he said. The idea is to promote "professional standards" in policy discussions, 
"not just out of political self-defense but as a matter of professional responsibility." 

The new efforts appear to have a who's who of supporters from among higher education leaders. 
The advisory board of the new institute includes Broad, Eaton and senior leaders of groups such 
as the AAC&U, the Association of Governing Boards of Universities and Colleges, the Council 
of Independent Colleges, the National Association of State Universities and Land-Grant 
Colleges, the State Higher Education Executive Officers, and the Southern Association of 
Colleges and Schools. 

The audience here seemed intrigued, but not necessarily totally sold on the ideas. AAC&U has 
been a proponent of assessment and accountability, but has also been criticized many such 
efforts, calling them oversimplified and potentially harmful. It did seem clear that those asking 
questions were dubious of at least some of the accountability measures already gaining 
popularity. 

One woman said that she is concerned that the tests currently being pushed for use by colleges 
seeking to demonstrate student learning outcomes lack "any evidence of validity," even as more 
institutions endorse their use. “I could buy a bathroom scale and get on it day after day after day 
and weigh 125 pounds and be very happy, but I’m not 125 pounds," she said. She said that if 
American society is moving toward the use of standardized tests to measure collegiate learning, 
"I would implore all of you to give us a standardized test with validity." 

Many academic observers may be relieved to know that Ikenberry, in responding, did not vow 
that the institute would create a new standardized test, and he in fact said that he wasn't looking 
for single measures. "There are no reliable instruments today," he said. Part of the problem, and 
part of why the institute is needed, he said, is that no one really knows what people want when 
they talk about accountability. Said Ikenberry: "Those who call for accountability honestly have 
no clear idea of precisely what they want — graduation rates, [Collegiate Learning Assessment] 
scores, time to degree, or something else." 
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Commentary 

Frances Stage and Jody Clark Vaisman 
New York University 
September 2010 

Jaschik’s January 2009 article, “Assessing Assessment,” describes initiatives designed to 
extend and broaden nascent assessment of college students learning. In the post-Spellings era of 
No Child Left Behind, many responded to the continuing discussion, “Why now?” He reports on 
two organizations, the National Institute for Learning Outcomes Assessment that is working to 
produce a national picture of the state of efforts to measure student learning and the New 
Leadership Alliance for Student Learning and Accountability working for institutional and 
individual endorsements of the principles for assessment and accountability. It has been a year 
since establishment of these initiatives, and the web page of the first, the National Institute, is a 
gem for institutions and practitioners— with documents of presentations, occasional papers, and 
links to assessment resources. The New Leadership Alliance board of directors includes an 
interesting mix of presidents from many different types of organizations (education, government, 
foundations). Both groups have broad support from a mix of foundations (Lumina, Carnegie, and 
Teagle) accreditation bodies, government organizations, and scholars and include support from 
the American Association of Colleges and Universities, American Council on Education, 
Association for Institutional Research, and Association for the Study of Higher Education. 

These initiatives are welcome because unfortunately much assessment of college 
students’ learning has been measured at rudimentary levels by college officials as well as 
researchers. Did the students feel good? Did it seem like they learned something? Worse, much 
research that relates college student experiences to learning is based on these low levels 
measures. We know from research based on self-efficacy that feeling good while learning and 
feeling confident about ability to learn can enhance learning (Bandura 1999). However, we also 
know that just because students feel as if they are learning it does not mean they are. 

Kirkpatrick and Kirkpatrick (2006) discuss the importance of assessing learning in 
training programs at four levels: reaction, learning, behavior, and results. Briefly, translated into 
where we are in our assessment of college students. Many studies focus on self-reported reaction 
- how satisfied students were with the learning experience. The second level in the assessment 
model is learning measured as content gained and as changes in attitude. While classroom 
faculty have systematically labored to construct measures of student learning for specific 
content, most colleges and universities have no aggregate measures. Bringle and Hatcher (1996) 
do a good job with both these aspects of learning with college students engaged in service 
learning. At the behavior level most measures fall short, although a few individual institutions 
have measured behavioral outcomes of learning — using academic performances and evaluation 
of internships. Einally, the results for college students are played out over years in the workforce 
and reported in magazines of alums and sometimes tracked in baccalaureate origins research 
(Stage & Hubbard, 2009). However, these efforts are spotty across institutional types and 
consistently measured over time at very few institutions. The task remains to systematize such 
measures. 
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Fortunately, the Educational Testing Service, ACT, and accreditation agencies (e.g.. 
Middle States Commission on Higher Education, 2007) are working to raise levels of college 
student assessment beyond basic self-reported measures. Richard Shavelson (2010) and Roger 
Benjamin (2008) have worked on an instrument to measure learning— the Collegiate Eeaming 
Assessment. The most comprehensive resource on the topic, Shavelson’s (2010) Measuring 
College Learning Responsibly: Accountability in a New Era, is a basic requirement for anyone 
wanting to learn more about assessment. Shavelson provides plenty of background information 
such as the history and models of assessment including premier institutional models, Alverno 
College and Truman State University, both of which have longstanding exemplary assessment 
methods that no one has yet been able to scale up to large institutions. Most importantly, 
Shavelson describes the relatively new Collegiate Eeaming Assessment (CEA) instmment 
designed to measure college student learning. The computer-based test includes measures of 
critical thinking, analytical reasoning, problem solving, and communicating using performance 
tasks as well as analytic writing tasks. Early tests of the CEA are promising. 

The good news is that as soon as institutions begin to take assessment seriously, it is 
likely that faculty will as well. Using NSOPE data, a national survey of over 28,000 
postsecondary faculty, Hubbard (2005) found that faculty in science and math disciplines who 
perceived that administrators valued and rewarded teaching were more likely to use student- 
centered instmctional methods. Einally, we need to view learning at the college level as a 
national agenda item as has been the case in other countries. Instead of a reactionary approach to 
governmental initiatives, we need proactive leadership in higher education that values regular 
assessment which, in turn, will make both learning and good teaching more recognized and 
appreciated. 
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Discussion Questions 

For those who may wish to use this article for teaching and or professional development 

purposed, here are some guiding questions that may be helpful: 

1 . Now that No Child Left Behind has been criticized for the negative effects on education, and 
Margaret Spellings is no longer pushing the testing agenda, why is higher education suddenly 
concerned with assessment? 

2. Why aren’t final exams and final papers coupled with class evaluations good enough to 
measure college student learning? What are the advantages and disadvantages of this 
strategy? What about alternatives? 

3. What are ways to improve assessment outside of the accreditation process? 

4. How can the use and reporting of assessment results be improved? How can faculty be more 
involved in assessment? 

5. How can assessment be integrated into higher education so that it is not an “add on?” 




